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Abstract. We obtain non-symmetric upper and lower bounds on the rate of 
convergence of general monotone approximation/numerical schemes for par- 
abolic Hamilton Jacobi Bellman Equations by introducing a new notion of 
consistency. We apply our general results to various schemes including fi- 
nite difference schemes, splitting methods and the classical approximation by 
piecewise constant controls. 



1. Introduction 

In this article, we are interested in the rate of convergence of general monotone 
approximation/numerical schemes for time-dependent Hamilton Jacobi Bellman 
(HJB) Equations. 

In order to be more specific, the HJB Equations we consider are written in the 
following form 

(1.1) u t + F{t,x,u,Du,D 2 u) = in Q T := (0, T] x R N , 

(1.2) u(0,x) =u (x) in R N , 
where 

F(t,x,r,p,X) = sup {C a (t,x,r,p,X)} , 

aeA 

with 

C a (t,x,r, Pl X) := -tr[a a {t,x)X] - b a (t,x)p - c a {t,x)r - f a (t,x). 

The coefficients a a , b a , c a , f a and the initial data uo take values respectively in 
S N , the space of N x TV symmetric matrices, R w , R, R, and R. Under suitable 
assumptions (see (Al) in Section |2J), the initial value problem l|l.l|l - l|1.2jl has a 
unique, bounded, Holder continuous, viscosity solution u which is the value function 
of a finite horizon, optimal stochastic control problem. 

We consider approximation/numerical schemes for (|l.l|) - i|1.2fl written in the fol- 
lowing abstract way 

(1.3) S(h,t,x,u h (t,x),[u h ]t, x ) = in Q+ := Q h \ {t = 0}, 

u & (0,a;) = u M (a;) in g° : =g h n{t = 0}, 
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where S is, loosely speaking, a consistent, monotone and uniformly continuous 
approximation of the equation defined on a grid/mesh Qh C Qt- The ap- 

proximation parameter h can be multi-dimensional, e.g. h could be (At, Ax), At, 
Ax denoting time and space discretization parameters, Ace can be itself multi- 
dimensional. The approximate solution is Uh : Qh — > K, [it/i]t,;c is a function defined 
from Uh representing, typically, the value of Uh at other points than (t,x). We 
assume that the total scheme including the initial value is well-defined on some 
appropriate subset of the space of bounded continuous functions on Qh- 

The abstract notation was introduced by Barles and Souganidis 0j to display 
clearly the monotonicity of the scheme. One of the main assumptions is that <S* 
is non-decreasing in u% and non-increasing in [uh]t, x with the classical ordering of 
functions. The typical approximation schemes we have in mind are various finite 
differences numerical scheme (see e.g. Kushner and Dupuis and Bonnans and 
Zidani |Sj) and control schemes based on the dynamic programming principle (see 
e.g. Camilli and Falcone However, for reasons explained below, we will not 
discuss control schemes in this paper. 

The aim of this paper is to obtain estimates on the rate of the convergence of Uh 
to u. To obtain such results, one faces the double difficulty of having to deal with 
both fully nonlinear equations and non-smooth solutions. Since these equations 
may be also degenerate, the (viscosity) solutions are expected to be no more than 
Holder continuous in general. 

Despite of these difficulties, in the 80's, Crandall & Lions provided the first 
optimal rates of convergence for first-order equations. We refer to Souganidis |2"7] 
for more general results in this direction. For technical reasons, the problem turns 
out to be more difficult for second-order equations, and the question remained open 
for a long time. 

The breakthrough came in 1997 and 2000 with Krylov's papers [213 EU , and 
by now there exists several papers based on and extending his ideas, e.g. 
1111 1181 l2"2l I23| . The main idea of Krylov is a method named by himself "shaking 
the coefficients". Combined with a standard mollification argument, it allows one 
to get smooth subsolutions of the equation which approximate the solution. Then 
classical arguments involving consistency and monotonicity of the scheme yield a 
one-sided bound on the error. This method uses in a crucial way the convexity of 
the equation in u, Du, and D 2 u. 

It is much more difficult to obtain the other bound and essentially there are two 
main approaches. The first one consists of interchanging the role of the scheme 
and the equation. By applying the above explained ideas, one gets a sequence of 
appropriate smooth subsolutions of the scheme and concludes by consistency and 
the comparison principle for the equation. This idea was used in different articles, 
see mEJ[18, 20, 23]. Here, the key difficulty is to obtain a "continuous dependence" 
result for the scheme. Even though it is now standard to prove that the solutions 
of the HJB Equation with "shaken coefficients" remain close to the solution of 
the original equation, such type of results are not known for numerical schemes in 
general. We mention here the nice paper of Krylov where such kind of results 
are obtained by a tricky Bernstein type of argument. However, these results along 
with the corresponding error bounds, only hold for equations and schemes with 
special structures. 
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The second approach consists of considering some approximation of the equation 
or the associated control problem and to obtain the other bound either by proba- 
bilistic arguments (as Krylov first did using piecewise constant controls, (221121) ') or 
by building a sequence of appropriate "smooth supersolution" of the equation (see 
[2] where, as in the present paper, approximations by switching are considered). 

The first approach leads to better error bounds than the second one but it seems 
to work only for very specific schemes and with restrictions on the equations. The 
second approach yields error bounds in "the general case" but at the expense of 
lower rates. 

In this paper we use the second approach by extending the methods introduced 
in [2] . Compared with the various results of Krylov, we obtain better rates in most 
cases, our results apply to more general schemes, and we use a simpler, purely 
analytical approach. In fact our method is robust in the sense that it applies to 
"general" schemes without any particular form and under rather natural assump- 
tions. However, we mention again that in certain situations the first approach can 
be used to get better rates, see in particular |28| . 

The results in apply to stationary HJB equations set in whole space M. N . In 
this paper we extend these results to initial value problems for time-dependent HJB 
equations. The latter case is much more interesting in view of applications, and 
from a mathematical point of view, slightly more difficult. However, in our opinion 
the most important difference between the two papers lays in the formulation of 
the consistency requirements and the main (abstract) results. Here we introduce 
a new (and more general) formulation that emphasizes more the non-symmetrical 
feature of the upper and lower bounds and their proofs. It is a kind of a recipe 
on how to obtain error bounds in different situations, one which we feel is easier 
to apply to new problems and gives better insight into how the error bounds are 
produced. We also present several technical improvements and simplifications in 
the proofs and, finally, several new applications, some for which error bounds have 
not appeared before: Finite difference methods (FDMs) using the 0-method for 
time discretization, scmidiscrctc splitting methods, and approximation by piecewise 
constant controls. 

The results for finite difference approximations can be compared with the ones 
obtained by Krylov in |21l 1^2"] . As in , we get the rate 1/5 for monotone FDMs 
while the corresponding result in [22j ^ s 1/21- Of course, in special situations the 
rate can be improved to 1/2 which is the optimal rate under our assumptions. 
We refer to (2H| for the most general results in that direction, and to ^2] f° r the 
optimality of the rate 1/2. The results for semidiscrete splitting methods are new, 
while the ones for the control approximation we get 1/10 which is worse than 1/6 
obtained by Krylov in 22 j. It would be interesting to understand why Krylov is 
doing better than us here but not in the other cases. 

We conclude this introduction by explaining the notations we will use throughout 
this paper. By | • | we mean the standard Euclidean norm in any M. p type space 
(including the space of N x P matrices). In particular, if X € § , then \X\ 2 = 
tr(XX T ) where X T denotes the transpose of X. 

If w is a bounded function from some set Q' c into either E, R M , or the 
space of TV x P matrices, we set 

Mo = su p m*>y)l' 

(t,y)eQ' 
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Furthermore, for 8 £ (0, 1], we set 

r i \w{t,x) - w(s,y)\ 

[w\s = sup j — — ij-^tt and \w\ s = \w\ + [w\ s . 

(t,x)jt( StV ) (\x-y\ + \t-s\ l / 2 y 

Let C b (Q') and C°> S (Q'), 6 £ (0, 1], denote respectively the space of bounded con- 
tinuous functions on Q' and the subset of Cb(Q') in which the norm | • \g is finite. 
Note in particular the choices Q' = Qt and Q' — R . In the following we always 
suppress the domain Q' when writing norms. 

We denote by < the component by component ordering in R M and the ordering 
in the sense of positive semi-definite matrices in . For the rest of this paper we 
let p denotes the same, fixed, positive smooth function with support in {0 < t < 
1} x {|x| < 1} and mass 1. From this function p, we define the sequence of mollifiers 

{p e }e>0 as follows, 

The rest of this paper is organized as follows: In the next section we present 
results on the so-called switching approximation for the problem ljl.ip - H1.2|l . As in 
[2] , these results are crucial to obtain the general results on the rate of convergence 
of approximation/numerical schemes and are of an independent interest. Section [31 
is devoted to state and prove the main result on the rate of convergence. Finally we 
present various applications to classical finite difference schemes, splitting method 
and on the classical approximation by piecewise constant controls. 

2. Convergence Rate for a Switching System 

In this section, we obtain the rate of convergence for a certain switching system 
approximations to the HJB equation (jl.ip . Such approximations have be studied 
in (141 Ixj , and a viscosity solutions theory of switching systems can be found in 
[281 1171 IT?)] . We consider the following type of switching systems, 

(2.1) F i (t,x,v,d t Vi,Dv i ,D 2 v i )=0 in Q T , i £ T := {1, . . . , M}, 

v(0,x)=v a (x) in R N , 

where the solution v — («!,•■• is in R M , and for i £ 1, (t,x) £ Qt, r = 

(n, ■ ■ ■ , r M ) e R M , pt £ R, Px £ R w , and X £ S N , E t is given by 

Fi(t,x,r,pt,p x ,X) = ma,x\p t + sup C a (t 7 x,ri,p x , X);r, - Mir\, 

where the AiS are subsets of A, C a is defined below (jl.ip . and for k > 0, 

M.iT = min{rj + k}. 

Finally for the initial data, we are interested here in the case when vq = (uq, . . . , uq). 

Under suitable assumptions on the data (See (Al) below), we have existence 
and uniqueness of a solution v of this system. Moreover, it is not so difficult to see 
that, as k — > 0, every component of v converge locally uniformly to the solution of 
the following HJB equation 

(2.2) u t + sup £ a (x lU ,Du,D 2 u) = in Q T , 

u(0,x) = u (x) in R N , 
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where A = Uj Ai. 

The objective of this section is to obtain an error bound for this convergence. 
For the sake of simplicity, we restrict ourselves to the situation where the solutions 
are in C 0,1 (Qt), i-e. when they are bounded, Lipschitz continuous in x, and Holder 
1/2 in t. Such type of regularity is natural in this context. However, it is not 
difficult to adapt our approach to more general situations, and we give results in 
this direction in Section 

We will use the following assumption 

(Al) For any a € A, a a — \a a a aT for some N x P matrix a a . Moreover, there is 
a constant K independent of a such that 

Kli + Kli + Hi + nr + irir <K. 

Assumption (Al) ensures the well-posedness of all the equations and systems 
of equations we consider in this paper; we refer the reader to the Appendix for 
a (partial) proof of this claim. In the present situation, we have the following 
well-posedness and regularity result. 

Proposition 2.1. Assume (Al). Then there exist unique solutions v and u of 
(|2.1(l and (12.21) respectively, satisfying 

Mi + Mi < c, 

where the constant C only depends on T and K appearing in (Al). 

Furthermore, ifw\ andw2 are sub- and supersolutions of 1)2.1(1 or (12.2(1 satisfying 
wi(0, ■) < 102(0, •), then w\ < ui2- 

Remark 2.1. The functions er Q ,o Q ,c Q ,/ Q are a priori only defined for times t € 
[0, T]. But they can easily be extended to times [—r,T + r] for any r € M + in 
such a way that (Al) still holds. In view of Proposition 12 . II we can then solve our 
initial value problems 1(2.1(1 and 1(2.2(1 either up to time T + r and even, by using a 
translation in time, on time intervals of the form [— r, T + r]. We will use this fact 
several times below. 

In order to obtain the rate of convergence for the switching approximation, we 
use a regularization procedure introduced by Krylov |21llT]. This procedure requires 
the following auxiliary system 

(2.3) Ft(t,x,v e ,d t vt,Dvt,D 2 vt) = in Q T+£ 2, i e X, 

v £ (0,x) = v (x) in R N , 

where v e — (vf, ■ ■ ■ , v e M ), 

Fi{t,x,r,p t ,Px,M) = 

ma,x\pt+ sup C a (t + s,x + e,n,p x , X); r { - Mir \, 

L aeAi J 

0<s<e 2 ,|e|<e 

and L and Ai are defined below 1(1.111 and 1(2.1(1 respectively. Note that we use here 
the extension mentioned in Remark 12. II 

By Theorems I A . 1 1 and I A . 31 in the Appendix, we have the following result: 

Proposition 2.2. Assume (Al). Then there exist a unique solution v s : Q T+£2 — > 
K of ((2.3(1 satisfying 

\v £ \i + -\v e -v\ <C, 
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where v solves i|2.1|l and the constant C only depends on T and K from (Al). 

Furthermore, ifwi andui2 are sub- and supersolutions of 1)2. 3|1 satisfying u>i(0, •) < 
u>2(0, •), then ui\ < u>2- 

We are now in a position to state and prove the main result of this section. 

Theorem 2.3. Assume (Al) and vq — (uq, ■ ■ ■ ,uq). If u and v are the solutions 
of 1)2.2)1 and 1)2.1)1 respectively, then for k small enough, 

0<v z ~u< Ck 1/3 in Q T , i e 1, 

where C only depends on T and K from (Al). 

Proof. Since w = (it, . . . , u) is a subsolution of 1)2.1)1 . comparison for 1)2.1)1 (Propo- 
sition |OJ yields u < Vi for i e 1. 

To get the other bound, we use an argument suggested by P.-L. Lions [23 to- 
gether with the rcgularization procedure of Krylov [3lJ ■ Consider first system 1)2.3)1 . 
It follows that, for every 0<s<e 2 ,|e|<£, 

d t vf+ sup C a (t + s,x + e,v £ (t,x),Dv £ ,D 2 v £ ) <0 in Q T+£ 2, iel. 

aeAi 

After a change of variables, we see that for every < s < e 2 , |e| < e, v e (t — s, x— e) 
is a subsolution of the following system of uncoupled equations 

(2.4) d t Wi + sup C a (t, x, Wi, Dwi, D 2 Wi) = in Q e T , iel, 

where :— (s 2 ,T) x 1 N . Define v e :— v £ * p e where {p E }c is the sequence of 
mollifiers defined at the end of the introduction. A Riemann-sum approximation 
shows that v £ (t, x) can be viewed as the limit of convex combinations of v £ (t — s, x — 
e)'s for < s < e 2 and |e| < e. Since the v £ (t — s,x — e)'s are subsolutions of the 
convex equation 1)2. 4JI . so are the convex combinations. By the stability result for 
viscosity subsolutions we can now conclude that v £ is itself a subsolution of l|2. 4JI . 
We refer to the Appendix in pQ for more details. 

On the other hand, since v £ is a continuous subsolution of (|2.3|l . we have 

v £ < min v £ + k in Qt+e 2 ; i el. 

It follows that max, vf (t, x) — min, v\ (t, x) < k in Q T+e 2, and hence 

M-v £ \o<k, ijei. 
Then, by the definition and properties of v £ , we have 

\d t v £i -d t v ej \ <C^, \D n v ei -D n v sj \ <C^, neN, i,jel, 

where C depends only on p and the uniform bounds on v £i and Dv £i , i.e. on T and 
K given in (Al). Furthermore, from these bounds, we see that for e < 1, 

d t v £J + sup C a [v ej ] - d t v £i - sup C a [v £l ] 

aeAi aeAi 

Here, as above, C only depends on p, T and K. Since v £ is a subsolution of 1)2. 4J) . 
this means that, 

fc 

<9 t v £l + supC a (x,v £t ,Dv £t ,D 2 v £t ) < C— in Q £ T , iel. 

a€A £ 



< C— in Qfp, i,j e 1. 
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From assumption (Al) and the structure of the equation, we see that v ei —te Kt C-p- 
is a subsolution of equation 1(2.2(1 restricted to Q^. 

Comparison for ((2.2(1 restricted to Qj, fProposition l2.1(l yields 

v El -u<e Kt ( \v ei (e 2 ,-)-u(e 2 ,-)\ + Ct\ ) in Q e T , i£l. 



Regularity of u and Vi fProposition l2.1(l implies that 

|«(t,-)-«<(*,0lo<(Mi + [«i]i)e in [0,e 2 ]- 

Hence by Proposition 12.21 regularity of u and vf, and properties of mollifiers, we 
have 

k 

Vi — u < Vi — v ei + v si — u < C(e + — ) in Q e T , i£l. 
Minimizing w.r.t. e now yields the result. □ 



3. Convergence rate for the HJB equation 

In this section we derive our main result, an error bound for the convergence of 
the solution of the scheme (|1.3|l to the solution of the HJB Equation 1(1 - 11. 2f> . As 
in 0, this result is general and derived using only PDE methods, and it extends and 
improves earlier results by Krylov (23 12] , Barles and Jakobsen ^ . Compared 
to 0, we consider here the time-dependent case and introduce a new, improved, 
formulation of the consistency requirement. 

Throughout this section, we assume that (Al) holds and we recall that, by 
Proposition 12. II there exists a unique C 0,1 -solution u of ((1.1(1 satisfying |u|x < C, 
where the constant C only depends on T and K from (Al). In Sectional we will 
weaken assumption (Al) and give results for C° : " solutions, (3 € (0, 1). 

In order to get a lower bound bound on the error, we have to require a technical 
assumption: If {a^}i e x C A is a sufficiently refined grid for A, the solution associ- 
ated to the control set {«i}igi is close to u. In fact for this to be true we need to 
assume that the coefficients a a ,b a ,c a ,f a can be approximated uniformly in (t, x) 
by a ai , b ai , c Qi , f ai . The precise assumption is: 

(A2) For every 5 > 0, there are M £ N and {a^f^ C A, such that for any a E A, 
inf (\a a - a a > | + \b a - b a > |„ + \c a - c a > |„ + \f a - f ai |o) < S. 

l<i<M 

We point out that this assumptions is automatically satisfied if either A is a 
finite set or if A is compact and a a ,b a ,c a , f a are uniformly continuous functions 
of t, x, and a. 

Next we introduce the following assumptions for the scheme 1(1.3(1 . 

(51) (Monotonicity) There exists A, /i > 0, ho > such that if \h\ < ho, u < v 
are functions in Cb(Gh), and 4>{t) — e Mt (a + bt) + c for a,b,c> 0, then 

S(h,t, x, r + cj)(t), [u + <fi]t, x ) > S(h,t, x, r, [v] t , x ) + 6/2 - Ac in Q£. 

(52) (Regularity) For every h and <f> £ Cb(Gh), the function (t,x) i— > 
S(h,t,x,(/)(t,x),[4>]t,x) is bounded and continuous in and the function r i— > 
S(h,t,x,r, [4>}t,x) is uniformly continuous for bounded r, uniformly in (t, x) £ . 
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Remark 3.1. In (SI) and (S2) we may replace Cb(Gh) by any relevant subset of this 
space. The point is that (|1.3|1 has to make sense for the class of functions used. In 
Section 21 (7&(K ) is itself the relevant class of functions, while, in Section [SI it is 
C({0, 1, . . .,n T };C°< l ^L N )) (since Q h = {0, 1, . . . , n T } x R N ). 

Assumptions (SI) and (S2) imply a comparison result for the scheme l)1.3fl . see 
Lemma 13.21 below. 

Let us now state the key consistency conditions. 
(S3)(i) (Sub-consistency) There exists a function E\{K, h,e) such that for any 
sequence {0 £ } £ >o of smooth functions satisfying 

\d^°D"'Mx, t)\ < Ke 1 - 200 -^ in Q T , for any (3 € N, = € N N , 

where \f3'\ = Yli=i 01 ■> the following inequality holds: 

S(h, t, x, (j> £ (t, x), [0 £ ] i)X ) < <£ £t + F(t, x, <j>, D(j> e , D 2 (j) e ) + E 1 (K, h, e) in G+. 

(S3) (ii) (Super-consistency) There exists a function E2(K,h,e) such that for 
any sequence {4>e}s of smooth functions satisfying 

\d%° D 13 ' 4> e {x, t)\ < ^ e i-2/3o-|/3'l in q Tj for any ^ g N| ^ e 

the following inequality holds: 

S(h, t, x, <f> e (t, x), [4> e ] t , x ) > (j> £t + F(t, x, <f>, D<j) ei D 2 ^ e ) - E 2 (K, h, e) in G+ . 

Typically the <f> £ we have in mind in (S3) are of the form \e * Pe where {xe)e is 
a sequence of uniformly bounded functions in C 0,1 and p e is the mollifier defined at 
the end of the introduction. 

The main result in this paper is the following: 

Theorem 3.1. Assume (Al), (SI), (S2) and that (|1.3|) has a unique solution Uh 
in Cb(Gh)- Let u denote the solution of (|1.1I) - (|1.2I) . and let h be sufficiently small. 

(a) (Upper bound) // (S3)(i) holds, then there exists a constant C depending 
only n, K in (SI), (Al) such that 

u- u h < e^\(u - u aJl ) + \ a + Cmm(e + Ei(K,h,e)) in Gh, 

s>0 \ I 

where K — \u\\. 

(b) (Lower bound) // (S3)(ii) and (A3) holds, then there exists a constant C 
depending only p:, K in (SI), (Al) such that 

u - u h > -e M '|(uo - Uoh)~\o - C min (£ 1/3 + E 2 (K,h,e)) in Gh, 

e>0 \ / 

where K = \u\i. 

The motivation for this new formulation of the upper and lower bounds is three- 
fold: (i) in some applications, E\ ^ E 2 and therefore it is natural to have such 
disymmetry in the consistency requirement (see Section |5J , (ii) from the proof it 
can be seen that the upper bound (a) is proven independently of the lower bound 
(b), and most importantly, (iii) the new formulation describes completely how the 
bounds are obtained from the consistency requirements. The good ^.-dependence 
and the bad e dependence of E\ and E 2 are combined in the minimization process 
to give the final bounds, see Remark l3~2l below. 
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Since the minimum is achieved for e -C 1, the upper bound is in general much 
better than the lower bound (in particular in cases where E\ — E2). 

Finally note that the existence of a in Cb(Gh) must be proved for each par- 
ticular scheme S. We refer to [201 El f° r examples of such arguments. 

Remark 3.2. In the case of a finite difference method with a time step At and max- 
imal mesh size in space Ax, a standard formulation of the consistency requirement 
would be 

(S3p There exist finite sets / C_N_x N^,I C N x N N and constants K c > 0, 
kp,kp for f3 = (Pa,P') € 1,0 = {j3 ,/3') € I such that for every h = {At, Ax) > 0, 
(t, i) £ 5}, and smooth functions 

\<k + F{t, x, <f>, D<t>, D 2 4>) - S(h, t, x, <f>(t, x), [fl tiS )| 

< K c J2\9t°D '(f>\oAt k ^ + K c Y^\df°D p '(t>\ Ax^. 
Pel pel 

The corresponding version of (S3) is obtained by plugging <fi £ into (S3') and using 
the estimates on its derivatives. The result is 

E 1 (K,h,e)=E 2 (K,h,e) 

= KK C s 1 - 2 ^'^^ + KK C ]T e 1 - 2 ^-^'! Ax^ . 
Pel pel 

From this formula we see that the dependence in the small parameter e is bad since 
all the exponents of e are negative, while the dependence on At, Ax is good since 
their exponents are positive. 

Remark 3.3. Assumption (SI) contains two different kinds of information. First, 
by taking (j) = it implies that the scheme is nondecreasing with respect to the 
[u] argument. Second, by taking u = v it indicates that a parabolic equation - an 
equation with a u t term - is being approximated. Both these points play a crucial 
role in the proof of the comparison principle for HI.3|) (Lemma 13.21 below) . 

To better understand that assumption (SI) implies parabolicity of the scheme, 
consider the following more restrictive assumption: 

(SI') (Monotonicity) There exists A > 0, K > such that if u < v, u, v E Cb(Gh), 
and <fi : [0, T] — ► M is smooth, then 

S(h, t,x,r + (j>(t), [u + (f>]t. x ) 

>S{h,t,x,r,[v] ttX ) + <t>'{t)-KAt\(l>"\ -\<t> + {t) in Q+. 

Here h = {At, h') where h! representing a small parameter related to e.g. the space 
discretization. It is easy to see that (SI') implies (SI), e.g. with the same value for 
A and the following values of /x and h§: 

/i = A + l and h^ 1 = 2i<:e (A + 1)T (A + 1)(2 + (A + 1)T). 

Assumption (SI') is satisfied for all monotone finite difference in time approxima- 
tions of e.g. monotone Runge-Kutta methods and monotone multi-step meth- 
ods, both explicit and implicit methods. We have emphasized the word monotone 
because whereas many Runge Kutta methods actually lead to monotone schemes 
for p. 1(1 (possibly under a CFL condition), it seems that the most commonly used 
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multistcp methods (Adams-Bashforth, BDS) do not. We refer to for an example 
of a multistep method that yields a monotone approximation of (| 1 - 1 1> - 

Proof of Theorem 13. 1L We start by proving that conditions (SI) and (S2) imply 
a comparison result for bounded continuous sub and supersolutions of l|1.3|) . 

Lemma 3.2. Assume (SI), (S2), and that u,v <G Cb{Gh) satisfy 

S(h,t, x,u(t,x), [u] t .x) < gi inG^i 

S(h, t,x,v(t,x), [v]t, x ) > 92 inGh, 
where gi,g 2 € C b (Gh)- Then 

u-v< e^|(u(0, •) - v(0, -)) + |o + 2te^\( gi - g 2 )+\ , 
where A and \x are given by (SI). 

Proof. 1. First, we notice that it suffices to prove the lemma in the case 

(3.1) u(0,s)-«(0,x)<0 in G° h , 

(3.2) gi (t,x)-g 2 (t,x)<0 in Q h . 

The general case follows from this result after noting that, by (SI), 
w = v + e^ (|(«(0, •) ~ v(0, -)) + \ + 2t\( gi - g 2 ) + \ ) , 

satisfies S(h, t, x, w(t, x), [w] t . x ) > g\ in an d u (0> x ) ~ w (®i x ) < in C?°. 

2. We assume that l|3.1fl and (|3.2|l hold and, for b > 0, we set ipb{t) = e Plt 2bt where 
\x is given by (SI) and 

M(b) = sup{u — v — ipb} ■ 
Q h 

We have to prove that M(0) < and we argue by contradiction assuming that 
M(0) > 0. 

3. First we consider some b > for which M(b) > and take a sequence 
{(t n ,Xn)}n C Gh such that 

5 n := M(b) — (u — v — ipb)(tnt x n) — * as n — > oo. 

Since M(b) > and (|3.1|) holds, t n > for all sufficiently large n and for such n, 
we have 

.9i > S(h,t 

m %n-! Mtnj^n) ( u subsolution) 

> S(h,t + ^ + M(6)-<5„> + V> fc + M(&)]t„ !;c J (SI), = 

> w(<5„) 

+ S(h, t n , x n , v + A + M (b), [v + ip h + M (b)}t n , x J (S2) 

> oj(5 n ) + b - AM (b) + S{h, tn, x n ,v, [v] tn , Xn ) (SI), <j> = i> + M 

> u>(S n ) + b — XM(b) +52, (v supersolution) 

where we have dropped the dependence in t n ,x n of u, v and %pb for the sake of 
simplicity of notation. Recalling 1)3.2(1 and sending n — > oo lead to 

b - XM{b) < . 

4. Since M(b) < M(0), the above inequality yields a contradiction for b large, so 
for such b, M(b) < 0. On the other hand, since M(b) is a continuous function of 
b and M(0) > 0, there exists a minimal solution b > of M(b) = 0. For 5 > 
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satisfying b - S > 0, we have M(b - 6) > and M {b - S) -> as (5 -> 0. But, by 3 
we have 

6-5< AM (6 — 5), 

which is a contradiction for S small enough since 6 > 0. □ 

Now we turn to the proof of the upper bound, i.e. of (a). We just sketch it 
since it relies on the regularization procedure of Krylov which is used in Section 
We also refer to Krylov |2(J1 12 1| . Barles and Jakobsen for more details. The 

main steps are: 

1. Introduce the solution u £ of 

uf + sup F(t + s,x + e, u £ (t, x), Du £ , D 2 u £ ) — in Qt+e 2 , 

0<s<e 2 ,|e|<£ 

u £ (x,0) = u (x) inR N . 

Essentially as a consequence of Proposition l2.il it follows that u £ belongs to C ' 1 (Qt) 
with a uniform C 0,1 (QT)-bound K. 

2. By analogous arguments to the ones used in Section [3 it is easy to see that 
u £ := u £ * p £ is a sub-solution of i|l.lfl . By combining regularity and continuous 
dependence results ("Theorem IA.3I in the Appendix), we also have \u e — u\q < Ce 
where C only depends T and K in (Al). 

3. Plugging u e into the scheme and using (S3) (i) and the uniform estimates on u £ 
we get 

S(h,t,x,u £ (t,x), [ue]t,x) < Ex(K,h,e) in , 

where K is the above mentioned C 0,1 -uniform estimate on u £ which depends only 
on the data and is essentially the same as for u. 

4. Use Lemma 13.21 to compare u e and and conclude by using the control we have 
on u — u e and by taking the minimum in e. 

We now provide the proof of the lower bound, i.e. of (b). Unfortunately, 
contrarily to the proof of (a), we do not know how to obtain a sequence of approxi- 
mate, global, smooth supersolutions. As in [2, we are going to obtain approximate 
"almost smooth" supersolutions which are in fact supersolutions which are smooth 
at the "right points" . We build them by considering the following switching system 
approximation of (| 1 . 1 1> : 

(3.3) F £ (t,x,v £ ,d t v £ ,Dv £ ,D 2 v £ ) = in Q T+2e , , i e I := {1, . . . , M}, 

v £ {0,x) = v (x) in R N , 
where v £ = (vf, ■■■ , v £ M ), v = (u , u Q ), 

(3.4) F £ (t,x,r,p t , Px ,X) = 

max^p t + min (t + s - e 2 , x + e, n,p x , X); n - M%r >, 

and C and M. are defined below and (|2.1|) respectively. The solution of this 
system is expected to be close to the solution of <|l.lll if k and e are small and 
C A is a sufficiently refined grid for A. This is where the assumption (A2) 
plays a role. 

For equation l|3.3(l . we have the following result. 
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Lemma 3.3. Assume (Al). 

(a) There exists a unique solution v £ of l|3.3|) satisfying \v e \\ < K , where K only 
depends on T and K from (Al). 

(b) Assume in addition (A2) and let u denote the solution of For i G I, 
we introduce the functions vf : [— e 2 , T + e 2 ] x M. N — ► R defined by 

vf(t,x) :=vl(t-e\x). 

Then, for any S > 0, there are M G N and {a{\jZ-i C A such that 

max, \u - vf\ Q < C*(e + fc 1/3 + 5), 

where C only depends on T and K from (Al). 

In order to simplify the arguments of the proof of the lower bound (to have the 
simplest possible formulation of Lemma 13.51 below) , we need the solutions of the 
equation with "shaken coefficients" to be defined in a slightly larger domain than 
Qt- More precisely on 

Qt := (-e 2 , T + e 2 } x R N . 
This is the role of the vf's. In fact they solve the same system of equations as 
the if's but on Q e T and with L ai (t + s — e 2 ,x + e,ri,p x , X) being replaced by 
C m (t + s,x + e,r uPx ,X) in 

The (almost) smooth supersolutions of we are looking for are built out of 
the C|'s by mollification. Before giving the next lemma, we remind the reader that 
the sequence of mollifiers {p e }e is defined at the end of the introduction. 

Lemma 3.4. Assume (Al) and define v ei :— p e * vf : Q T+£2 — > R for i G T. 

(a) There is a constant C depending only on T and K from (Al), such that 

\v S j - vf | < C{k + e) in Q T + £ 2 , i,j 6l 

(b) Assume in addition that e < (8 swp i [vf]i)^ 1 k. For every (t,x) G Qt, if 
j := argmin ieI u e i(t,a;), then 

d t v ej (t,x) + C a >{t 1 x,v E , ] {t,x),Dv Ej (t 1 x) 1 D 2 v £ , ] (t,x)) > 0. 

The proofs of these two lemmas will be given at the end of this section. 
The key consequence is the following result which is the corner-stone of the proof 
of the lower bound. 

Lemma 3.5. Assume (Al) and that e < (8 supjw|]i) _1 fc. Then the function 
w := minigxi'ei is an approximate supersolution of the scheme (|1 . H|l in the sense 
that 

S{h, t, x, w(t, x), [w]t, x ) > -E 2 (K, h, s) in £+, 
where K comes from Lemma XSJA 

Proof. Let (t, x) G Qt and j be as in Lemma l3~4l fb'). We see that w(t, x) = v e j(t, x) 
and w < v E j in Qh, and hence the monotonicity of the scheme (cf. (SI)) implies 
that 

S(h,t,x,w(t,x), [w]t, x ) > S(h,t,x,v ej (t,x), [v ej ] ttX ). 
But then, by (S3)(ii), 

S(h,t,x,w(t,x), [w]t, x ) 

> d t v £j (t, x) + C a > (t, x, v sj (t, x), Dv £j (t, x), D 2 v £J (t, x)) - E 2 (K, h, e), 
and the proof complete by applying Lemma \3. 41 (h). □ 
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It is now straightforward to conclude the proof of the lower bound, we simply 
choose k — 8 sup.Jif]i£ and use Lemma 13.21 to compare Uh and w. This yields 

u h - w < e^*|(« h) o - w{0, -)) + |o + 2te^E 2 (K, h, e) in Q h , 

But, by Lemmas 13.31 (b) and !3.4l (a,), we have 

\w-u\o < C(e + k + k 1/3 + S), 

and therefore 

u h - u < e"*|(u M - m )+|o + 2te^E 2 (K, h,e) + C(e + k + k 1 ' 3 + 5) in Q h , 

for some constant C. In view of our choice of k, we conclude the proof by minimizing 
w.r.t e. 

Now we give the proofs of Lemmas 13.31 and 13.41 
Proof of Lemma \3.3l 1 . We first approximate 1(1.1(1 by 

v t + sup£ a ' (t, x, v, Dv, D 2 v) = in Q T , 

iei 

v(0,x)=u o (x) in R N . 

From assumption (A2) and Lemmas I A . 1 1 and I A . 31 in the Appendix, it follows that 
there exists a unique solution v of the above equation satisfying 

\v - u\ < CS, 

where C only depends on T and K from (Al). 

2. We continue by approximating the above equation by the following switching 
system 

max ^dtVi + C ai (t, x,Vi, Dvi, D 2 Vi); Vi — A^t; j = in Qt, i el 

v(0,x)=v o {x) in R N , 

where vo = (uq, ■ ■ ■ ,uq) and M. is dehncd below (|2.1|l . From Proposition 12. II and 
Theorem O in Section we have existence and uniqueness of a solution v = 
(ui, • • • , vm) of the above system satisfying 

l^-vlo^Ck 1 / 3 , i el, 

where C only depends on the mollifier p, T, and K from (Al). 

3. The switching system defined in the previous step is nothing but 1)3. 3J1 with e = 
or 1)2.3(1 with the ^4i's being singletons. Theorems IA.1I and I A. 31 in the Appendix 
yield the existence and uniqueness of a solution v £ : Qt+2e 2 - ^ K of 1)3.3(1 satisfying 

\v s \i + ±\v e -v\o<C, 
where C only depends on T and K from (Al). 

4. The proof is complete by combining the estimates in steps 1 - 3, and noting 
that \v £ — v e \ < [v £ ]\£ in Qt+ e 2 an d (A2) is only needed in step 1. □ 

Proof of Lemma \3.4\ We start by (a). From the properties of mollifiers and the 
Holder continuity of v e , it is immediate that 

(3.5) \v ei -v e t \<Ce in Q T+e 2 , »6l, 
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where C = 2maxi[wf]i = 2maxi[ff]i depends only on T and K from (Al). Fur- 
thermore as we pointed out after the statement of LemmaEIl v £ solves a switching 
system in Qj,, so arguing as in the proof of Theorem 12. 31 in Section [21 leads to 

< maxwf — minuf < k in Q £ T . 

i i 

From these two estimates, (a) follows. 

Now consider (b). Fix an arbitrary point (t,x) € Qt and set 

j = a,rgmm ieJ v £l (t, x). 

Then, by definition of M and j, we have 

v £ j(t, x) — M.jV e (t, x) = max.{v e j(t, x) — v £ i(t, x) — k} < —k, 

and the bound (|3.5|) leads to 

v £ (t,x) - MnV £ (t,x) < -k + 2max[?;f]i2e. 

Next, by using the Holder continuity of v E fLemma for any (i,x) £ Q^, we 
have 

vUt,x) - MjV 6 (t,x) < -fc + 2maxk?] 1 (2e+ \x - x\ + \t-t\ 1/2 ). 

From this we conclude that if |x — x\ < e, \t — i\ < e 2 , and e < (8maxi[wf]i) _1 fc, 
then 

v £ j(t, x) - MjV £ (t, x) < 0, 
and by equation l|3.3|) and the definition of v £ , v £ (t, x) — v £ (t — e 2 , x), 

d t v e Ji,x)+ inf C a i{i+s,x + e,v £ S,x),Dv £ Ai,x),D 2 v £ At,x)) = 0. 

J 0<s<e 2 ,|e|<£ J 

After a change of variables, we see that, for every < s < e 2 , \e\ < e, 

(3.6) d t v £ (t — s, x — e){t, x) 

+ C ai (t,x,v E j (t- s,x- e),Dv £ {t -s,x- e), D 2 v £ {t - s, x - e)) > 0. 

In other words, for every < s < e 2 , |e| < e, v £ (t — s,x — e) is a (viscosity) 
supersolution at (t, x) of 

(3.7) Xt + C a i(t,x lX ,D X ,D 2 x) = 0. 

By mollifying l|3.6|) (w.r.t. the (s, e)-argument) we see that v e j is also a smooth 
supersolution of (|3.7|l at (t, x) and hence a (viscosity) supersolution of the HJB 
equation I jl.ip at (t,x). This is correct since v £ j can be viewed as the limit of 
convex combinations of supersolutions v £ (t—s, x—e) of the linear and hence concave 
equation H3.7|l . we refer to the proof of Theorem 12 . 31 and to the Appendix in for 
the details. We conclude the proof by noting that since v £ j is smooth, it is in fact 
a classical supersolution of at x. □ 
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4. Monotone Finite Difference Methods 

In this section, we apply our main result to finite difference approximations of 
based on the ^-method approximation in time and two different approxima- 
tions in space: One proposed by Kushner |13| which is monotone when a is diagonal 
dominant and a (more) general approach based on directional second derivatives 
proposed by Bonnans and Zidani but see also Dong and Krylov 11 J. For sim- 
plicity we take h — (At, Ax) and consider the uniform grid 

Gh = At{0, l,...,n T } x Ax1 N . 

4.1. Discretization in space. To explain the methods we first write equation 
jnj like 

u t + sup \ - L a u- c a (t,x)u- f a (t, x)\ =0 in Q T , 

where 

L a <j)(t, x) = tr[a a {t, x)D 2 (f>(t, x)] + b a (t, x)D<p(t, x). 

To obtain a discretization in space we approximate L by a finite difference operator 
Lh, which we will take to be of the form 

(4.1) L^(t, x) = J2 C%(t, x, P)(<P(t, x + f3Ax) - 4>(t, x)), 

pes 

for (t, x) £ Gh, where the stencil S is a finite subset of 1> N \ {0}, and where 

(4.2) C%(t,x,/3) > for all /3 G S, (t,x) e G%,h = (Ax, At) > Q,a e A. 

The last assumption says that the difference approximation is of positive type. This 
is a sufficient assumption for monotonicity in the stationary case. 

(i) The approximation of Kushner. 



We denote by {e{\f =1 the standard basis in K and define 

N a a+ a- 

(4-3) m = Y: A» + £ (-f- A+ - -f- A r ) + 6f*tf - b^S- 
j=i j^i 

where b + — max{6, 0}, b~ = (—b) + (b = b + — b~), and 

Sfw(x) — ± — — {w(x ± eiAx) — w(x)}, 
Ax 

Auw(x) = — — 7?{w(x + eiAx) — 2w(x) + w(x — eiAx)}, 
Ax z 

Afjw(x) = 2 {2w(x) + w(x + e^Ax + ejAx) + w(x — e^Ax — e^-Aa;)} 
— 2^ 2 ^ w ^ x e «Aa;) + w(x — eiAx) + w(x + ejAx) + w(x — ejAx)}, 
A^jVj(x) = — -^-^-^{2w(x) + w(x + eiAx — ejAx) + w(x — eiAx + e^-Aa;)} 
{w(x + eiAx) + w(x — eiAx) + w(x + ejAx) + w(x — e^Aa;)}. 
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The stencil is S — {±ei, ±(a ± ej) : i, j — 1, . . . , N}, and it is easy to see that the 
coefficients in 1(4. 1[) are 

C*(tx±e-) -^ {X) V |aS(x)l +^ ±(x) 

C h (t,x,±e t ) 2.1a^ + ^^' 

C^(t,x,e l h±e J h) = ^ , i^j, 

< T (x) 

C^{t,x,-e l h±e j h) = , i^j. 

The approximation is of positive type l|4.2f) if and only if a is diagonal dominant, 
i.e. 

(4.4) aS(t,aO-53|og(t,a:)|>0 in Q T) a € A i = l,...,iV. 

(ii) The approximation of Bonnans and Zidani. 
We assume that there is a (finite) stencil S C Z N \ {0} and a set of positive 
coefficients {ap : j3 € S} C R+ such that 

(4.5) a Q (t,a;) = ^ a%(t,x)/3 T (3 in Q T) a G A 

/36<S 

Under assumption (|4.5|l we may rewrite the operator L using second order direc- 
tional derivatives = tr[/3/3 T £> 2 ] = (/3 • D) 2 , 

L a <j){t, x) = Y^ s /a(*> x)D 2 (} (j){t 1 x) + b a (t, x)D<f>(t, x). 
peS 

The approximation of Bonnans and Zidani is given by 

N 

(4.6) = £ apApcj) + £ - 6?" «J: 



where is an approximation of given by 



pes »=i 

)2 



Aflw(x) = i 5 + /JAac) - 2w(a;) + w(x - (3Ax)}. 

1 '"' 1 Aa; 



In this case, the stencil is S — ±S U {±e 2 ; : i = 1, . . . ,N} and the coefficients 
corresponding to l|4.1|l are given by 

Aa; 

and the sum of the two whenever /3 = ej. Under assumption 14.5(1 . which is more 
general than (|4.4() (see below), this approximation is always of positive type. 



For both approximations there is a constant C > 0, independent of Ax, such 
that, for every 4> & C A (R N ) and (t,x) £ <?+, 

(4.7) |L a ^(t,i)-L^(t,a)| ^Cd^lol^D^loAx + la^lol^loAa: 2 ). 
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4.2. The fully discrete scheme. To obtain a fully discrete scheme, we apply the 
^-method, •& <E [0,1], to discretize the time derivative. The result is the following 
scheme, 

(4.8) u(t,x) = u(t- At,x) 

- (1 - <&)At sup{-L> - c a u - f a }{t - At, x) 

aeA 

-$Atsup{-L%u- c a u- f a }{t,x) in Q+. 

aeA 

The case d = and $ = 1 correspond to the forward and backward Euler time- 
discretizations respectively, while for § = 1/2 the scheme is a generalization of the 
second order in time Crank-Nicholson scheme. Note that the scheme is implicit 
except for the value i? = 0. We may write l|4.8|) in the form (|1.3I) by setting 



S(h, t,x,r, [u] t , x ) = sup ff-Jr-^+^V^ (t, x, /3)1 r 

■ " ih + (1 - d)c ' a - - ^ E c % (*> x ' Mt,x(-At, o) 

pes 

C%(]t,x,0) [ti[u] tiX (0,(3Ax) + (1 - tf)[u] M (-At,/3Az)] }, 



-E 1 

/3eS 

where [u] t . x {s,y) — u(t + s,x + y). Under assumption (|4.2I) the scheme (|4.8|) is 
monotone (i.e. satisfies (SI) or (SI')) provided the following CFL conditions hold 

(4.9) At(l-$)(-c a (t,x) + Y / C%(t 7 x,f3)) < 1, 

pes 

(4.10) Atd(c a {t,x) - Cg(t,x,pj) < 1. 

pes 

Furthermore, in view of (Al) and (|4.7Jl . Taylor expansion in H4.8(l yields the follow- 
ing consistency result for smooth functions <f> and (t, x) G Qt, 

\<j> t + F(t, x, <f>, D<j>, D 2 <j>) - S{h, t, x, (j), [0] t)X )| 

< C(At\<f> tt \o + Ax\D 2 <f>\ + Ax 2 \DU\o + (1 - t?)At(|D^|o + |^ 2 t |o))- 

The (1 — #)Ai-term is a non-standard term coming from the fact that we need the 
equation and the scheme to be satisfied in the same point, see assumption (S3). 
The necessity of this assumption follows from the proof of Theorem 13. II 

We have seen that if (|4.2|) and l|4.7|) hold along with the CFL conditions (|4.9|) 
and (|4.10|l then the scheme l|4.8|l satisfies assumptions (SI) - (S3) in Section [3] 
Theorem 13. II therefore yields the following error bound: 

Theorem 4.1. Assume (Al), (A2), i|P)l. g^J, 63, fHty hold. If u h E C b {G h ) 
is the solution of Ij4.8|l and u is the solution of (|1 . 1|) . then there is C > such that 
in Q h 

-e^Kuo - uo lh )-|o - C\h\i <u-u h < e^\(u Q - u , h ) + \ + C\h\*, 



where \h\ := y/Ax 2 + At. 

Remark 4.1. Except when = 1, the CFL condition (|4.9|1 essentially implies that 
At < CAx 2 . Therefore At and Ax 2 play essentially the same role. Also note that 
the CFL condition P~TU)l is satisfied if e.g. At < (sup Q |(c Q ) + | ) _1 . 
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Remark 4.2. Even though the above consistency relationship is not quite the "stan- 
dard" one, it gives the correct asymptotic behavior of our scheme. First of all note 
that the new term, the (1 — #)-term, behaves just like the At and Ax 2 terms. To 
see this, we note that according to (S3) we only need the above relation when 4> is 
replaced by (f> e defined in (S3). But for (f> e we have |0 Ej tt|o ~ \D 4 (j> E \o ~ \D 2 <f) £ , t \o ~ 
Ke~ 3 . By the CFL conditions l|4.9[) and (|4.1l)|l we have essentially that Ax 2 « At, 
so 

At\<p ettt \o « Ax 2 \D 4 £ \ o a At\D 2 <j) £ , t \ w KAx 2 e~ 3 . 
Next note that for $ = 1/2 (the Cranck-Nicholson case) the scheme is formally 
second order in time. However this is no longer the case for the monotone version. It 
is only first order in time due to the CFL condition which implies that Ax 2 ||-D 4 </>|| = 
C*At||L> 4 (/»ll- 
Proof. In this case 

E 1 {K,h,e) = E 2 (K,h,E) 

= C(Ate- 3 + Axe' 1 + AarV 3 + (1 - tf)Ai( £ - 2 + e~ 3 )). 
So we have to minimize w.r.t. e the following functions 

e + C(Ate- 3 + Axe" 1 + Ax 2 e~ 3 ), 

e 1/3 + C(Ate- 3 + Axe- 1 + Ax 2 e- 3 ). 

By minimizing separately in At and Ace, one finds that e has to be like At 1 / 4 and 
Ax 1 / 2 in the first case, and that e 1 / 3 has to be like At 1 / 10 and Ax 1 / 5 in the second 
case. The result now follows by taking e = max(At 1 / 4 , Ax 1 / 2 ) in the first case and 
e 1 / 3 = max(At 1 / 10 , Ax 1 / 5 ) in the second case. □ 

4.3. Remarks. For approximations of nonlinear equations monotonicity is a key 
property since it ensures (along with consistency) that the approximate solutions 
converge to the correct generalized solution of the problem (the viscosity solution 
in our case). This is not the case for nonmonotone methods, at least not in any 
generality. 

However, the monotonicity requirement poses certain problems. Monotone schemes 
are low order schemes, and maybe more importantly, it is not always possible to 
find consistent monotone approximations for a given problem. To see the last point 
we note that in general the second derivative coefficient matrix a is only positive 
semidefinite, while the monotone schemes of Kushner and Bonnans/Zidani require 
the stronger assumptions (|4.4|) and l|4.5|l respectively. In fact, in Dong and Krylov 
jll| it was proved that if an operator L admits an approximation Lh of the form 
(|4.1|l which is of positive type, then a has to satisfy H4.5(l (at least if a is bounded). 

This is a problem in real applications, e.g. in finance, and it was this problem 
was the motivation behind the approximation of Bonnans and Zidani. First of all 
we note that their condition l|4.5[) is more general than 1)4. 4|l because any symmetric 
N x N matrix a can be decomposed as 

N a+ a- 

where the coefficients are nonnegative if and only if a is diagonal dominant. More 
importantly, it turns out that any symmetric positive semidefinite matrix can be 
approximated by a sequence of matrices satisfying 1)4.5(1 . In Bonnans, Ottenwaelter, 
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and Zidani 4 , this was proved in the case of symmetric 2x2 matrices along with 
an explicit error bound and an algorithm for computing the approximate matrices. 
Because of continuous dependence results for the equations, convergence of the 
coefficients immediately imply convergence of the solutions of the corresponding 
equations. Hence the Bonnans/Zidani approximation yields a way of approximating 
general problems where a is only positive semidefinite. 

5. Semigroup Approximations and Splitting Methods 

In this section, we consider various approximations of semigroups obtained by 
a semi-discretization in time. In order to simplify the presentation we start by 
specializing Theorem 13. II to the semigroup setting. To be precise we consider one- 
step in time approximations of Hl.lfl given by 

(5.1) u h (t n ,x) = Shitmtn-ijUhitn-^x) in R N , 

Uh(0,x) = Uh,o(x) in R N , 

where to = < t\ < ■■■ < t n < ■■■ < t nT = T, h := max„(t„ + i — t n ), and 
the approximation semigroup Sh satisfies the following sub and superconsistency 
requirements : There exist a constant K c , a subset / of N x N w , and constants 7^ , 5p 
for (3 £ I such that for any smooth functions <fi, 

(5.2) — [S h (t n , i n _i) - l] 4(tn-i,x) - F(t, x, <j>, Dcf>, D 2 (f>) t=tn 

<K c Y,\d!°D^'^M s ^ 
Pel 

where (3 = (/?o, 0') G I for fto £ N and (3' £ N N , and in a similar way 

(5.3) — [s h {t n , t n -i) - l] <p{t n -i,x) - F(t, x, cf>, D<f>, D 2 (f>) t=tn 

pel 

with corresponding data K c , 1, 73, 8p. We say that the semigroup is monotone if 
4> < ip => Sh{t n ,t n -i)<t> < Sh(t n ,tn-i)ip, n=l,...,nr, 

for all continuous bounded functions 4>, ip for which Sh{t)4> and Sh(t)ip are well 
defined. 

We have the following corollary to Theorem 13. II 

Proposition 5.1. Assume (Al), (A2), and that Sh is a monotone semigroup sat- 
isfying (15.21) and (|5.3() and which is defined on a subset of Cb(M. N ). If u is the 
solution of Ql. If) and Uh is the solution of (|5.1|l . then 

-C(\u - u M | + At~t° Ari ) <u-u h < C7(K - u M | + Ai^ 2 ) 
in WL N , where 

■ f °P 
r± := mm 



r2 := mm 



pel I 3(2/? + |/?'| - 1)7/3 



pel l(2/3 + W\ - 1)7/3 
where \(3'\ denotes the sum of the components of (3 1 . 
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Proof. We define 

S(h, t n , X, Uh, [Uh]t n ,x) = ^7 (uh{t n , x) - [Uh]t n ,x^j , 

where 

[u>h]t n ,x = Sh(t n -l,t n )Uh{t n -l, x). 

To apply Theorem 13. II we just have to check that (SI) - (S3) hold and this is clear 
for (SI) and (S2) (see Remark l3~Tj) . For (S3)(i), note that by (O we have 

(f>t + F(t n ,x, 0, Dcj>, D 2 (f>) - S(h, t n , x, 0, [(j>]t„,x) 

< \\%4>\ te + K c Y,\d?D?<i>\Z>*t s >>, 

Pel 

which leads to 

Pel 

The upper bound now follows by optimizing with respect to e as in the proof of 
Theorem 14.11 In a similar way we may use (|5.3|) to define E 2 and then conclude 
the lower bound. □ 

Remark 5.1. In view of the consistency requirements (|5.2() and (|5.3(l . for schemes 
like (|5.1(l it is natural to think that only the x-variable is really playing a role and 
that one can get results on the rate of convergence by using this special "semi- 
group type" structure. More specifically, one might think that a different proof 
using a mollification of the solution with respect to the space variable only, can 
produce the estimates in an easier and maybe better way. We tried this strategy 
but we could not avoid using the short time expansion of the solution of the HJB 
Equation associated with smooth initial data (the short time expansion of the semi- 
group), and this leads to worse rates, even in cases where F is smooth. One way of 
understanding this - without justifying it completely - consists of looking at our 
estimates for the ^t-term (cf. (S3) (i) and (ii)). The present approach leads to an 
estimate of order e~ 3 , while if we use the short time expansion, we are lead to a 
worse estimate of order e -4 . We refer the reader to Subsection l5 . II and in particular 
to Lemma l5.6l below. where short time expansions for semi-groups are obtained and 
used to study the rate of convergence for splitting problems. 

5.1. Semidiscrete splitting. We consider an equation of the form 

(5.4) u t + F 1 (D 2 u) + F 2 (D 2 u) =0 in Q T , 

where 

Fj{X) = sup{-tr[a?X] - /<*}, j = 1, 2, 

and a J > are matrices and /j* real numbers. We assume that they are both 
uniformly bounded in a and are independent of (t,x). It follows that F± and F2 
are Lipschitz continuous and that (Al) is satisfied. 

Let S denote the semigroup of l|5. 4JI . i.e. S(At)<fi is the solution at time t = At of 
(|5.4(l with initial value (f>. Similarly, let Si and S2 denote the semigroups associated 
with the equations u t + Fi(D 2 u) = and u t + Fi(D 2 u) = 0. 
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We can define a semidiscrete splitting method by taking Ij5.1|l with t n := nAt 
and 

(5.5) 5 h (t„_i,t„) = Si(At)S 2 (At). 

Under the current assumptions all these semigroups map W 1 ' 00 (R ) into itself, 
they are monotone, and they are nonexpansivc, 

\S(W\o < |0}o, 

for £ W /1, °°(IR Ar ) and where 5 denotes one of the semigroups above. 

As soon as we know the consistency relation for this scheme, we can find an error 
bound using Theorcm l5.ll However, contrarily to the case of finite different schemes 
in the previous section, here the precise form of the consistency requirement is not 
well known. We are going to provide such results under different assumptions on 
Fi , F 2 . Our first result is the following: 

Lemma 5.2. Under the above assumptions, if in addition \DFi\ E W 1 ' 00 (S ) and 
\DF 2 \ € W 3 '°°(B N ), then 

- C(At\D 2 <j> t \o + At 2 \D 5 (f>\l) - h.o.t. 

< -^[Sh(t) - l]4>{t n -i,x) +F 1 {D 2 <P{t n ,x)) + F 2 {D 2 ct ) {t ni x)) 

< C(At\D 2 <j) t \o + At\D 3 4>\l) + h.o.t. 

for all smooth functions <p, where "h.o.t." stands for "higher order terms". 

Remark 5.2. Due to the convexity of the equation, in this example the upper and 
lower bounds are different. 

Remark 5.3. We have only stated the principal error terms, the terms deciding the 
rate. The other terms are put in the "h.o.t." category. Since the principal error 
terms need not be the lowest order terms (see the first inequality in Lemma |5.2fl . 
maybe a better name than "h.o.t." would be the "less important terms". 

A direct consequence of Proposition 15 . II is the following result: 

Corollary 5.3. Let Uh denote the solution of (|5.1I) where Sh is defined in (|5.5() 
and U} lt o = uq, and let u be the solution of (|5.4(l with initial value uq. Under the 
assumptions of Lemma \5.S\ we have 

-CAm <u- u h < CAti in At{0, 1, 2, . . . , n T } x R N . 

Next, we give the result when F\ and F 2 are assumed to be only Lipschitz 
continuous (which is the natural regularity assumption here). In this case the 
consistency relation is: 

Lemma 5.4. Under the above assumptions, if F\ and F 2 are only Lipschitz con- 
tinuous, we have 

j^ t [S h {t) - l]0(tn_i,:c) +F 1 (D 2 <f>(t n ,x)) + F 2 {D 2 cj){t n ,x)) 

< CAt\D 2 <t> t \ + CAt^\D 3 (/>\ + h.o.t. 
for all smooth functions (j). 

Again as a direct consequence of Proposition 15.11 we have the following error 
bound: 
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Corollary 5.5. Under the assumptions of Corollaru \5.!A but where Fi and F 2 are 
only assumed to be Lipschitz continuous, we have 

-CAm < u - u h < CAis in At{0, 1, 2, . . . , n T } x R N . 

Remark 5.4. We see a slight reduction of the rates in the Lipschitz case but not as 
important as one might have guessed. For first order equations these methods lead 
to the same rates in the smooth and Lipschitz cases. 

Remark 5.5. If we change operators Si,S 2 so that Si(t)(f> and S 2 (t)(j> denote the 
viscosity solutions of 

u(x) = (j>{x) - tF 1 (D 2 u(x)) in R N , 
u(x) = <j>(x) - tF 2 (D 2 u(x)) in R N , 
respectively, then the statements of Corollary 15 . 31 and 15 . 51 still hold. 

In the proofs of Lemmas 15 . 21 and 15 .41 we will use the following lemma: 
Lemma 5.6. Let S be the semigroup associated to the equation 

u t + F(D 2 u) = 0, 
where F is Lipschitz, convex, and non-increasing. Define F$ by 

F 5 =F* p s , 

where ps{X) = 5~ N p(X/5) and p is a smooth function on E>(N) with mass one 
and support in B(0, 1). Then for any smooth function 4>, 

S{t)cp -4> + tFs(D 2 (f>) < tS\DF\ + h 2 \DF\ \DF 5 \o\D 4 q>\ , 

and 

S(t)<j> - + tF s {D 2 <P) > -^t 2 \DF\ (\D 2 F s \ \D 3 <f>\t + \DFs\o\DU\o)- 
The proof of this result will be given after the proofs of Lemmas 15 . 21 and 15 . 41 

Proofs of Lemmas \5.<H and \5.4\ In order to treat the two results at the same time, 
we mollify F\ and F2 and consider F\ t s and F 2i $ (see Lemma l5.6l for the definitions). 
By Lemma 15.61 we have the following (small time) expansions: 

(5.6) S s (t)(f>- 4> + tF^ s {D 2 4>) < tSlDFjlo + h 2 \DF 3 \ \DF h S \ \D A 4>\ , 

(5.7) S^t^-^ + tF^D 2 ^) 

> -\t 2 \DFM\D 2 F,MD^\l + \DF j!S \ \DU\o), 

for smooth functions <f> and j = 1,2. 

Now we want to find an (small time) expansion for Sh ■ We write 

S h (t)(b- ( j ) + t{F 1 +F 2 )(D 2 ( j ) ) 

= [5i(t)5 2 (t)0 - Si(t)(<f> ~ tF 2 j{D 2 <j>))] 

+ - tF 2 ,s(D 2 <l>)) - 4> + tF ltS {D 2 4>) + tF 2 j(D 2 ^)] 

+ t[(Fi + F 2 ){D 2 ^) - {F lt5 + F 2 , S )(D 2 4>)]. 

In view of the Lipschitz regularity and convexity of F\ and F 2 , the last term on 
right hand side is between —CtS (Lipschitz regularity) and (convexity), while the 
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first 2 terms can be estimated using non-expansiveness and small time expansions 
for Si and S 2 . The principal error term comes from the small time expansion for 
the term Si(t)(<f> - tF 2 . s (D 2 (j))). In view of JUSJ and (£T7|, 

M|£>Fi|o + ^ 2 |£>F 1 |o| J DFi )5 |o| J D 4 {^-t J F|(D 2 ^)}| 
is an upper bound on the principal error term, while 



|D 2 Fi, 5 | |D 3 {(/. - tF 2 , 5 (D 2 <j>)}\ 2 + \DF u \o\D 4 {0 - tF 2 ,s(D 2 <t>)}\Q 



is a lower bound. Expanding out these expressions keeping only the "worst terms" 
and bearing in mind the Lipschitz regularity of F± and F 2 , lead to the following 
upper and lower bounds respectively, 

C(t6 + i 2 |£ 4 0| o + t 3 \D 4 F 2t5 \ Q \D 3 ( f ) \t ) ) and 

CI^Fi^lo^lC^l'+^l^^lolC^I^ + t 4 ^ 3 ^! 2 ^ 3 ^^). 
To conclude the proofs of the upper bounds in Lemmas 15.21 and 15.41 we note that 

1 [S h {t) - l](j>{t n - x ,x) + F 1 (D 2 <f>(t n ,x)) + F 2 {D 2 cj){t ni x)) 



At 

^AtdDF.lo + lDF^D 2 



At 



[S h (t) - l}0 + F^D 2 



F 2 (D 2 



In view of the above estimates the right hand side can be upper bounded by 



(5.8) 



C 



At\D 2 &\ 



At\D 



At 2 \D 4 F 2 x\ \D 



3^|4 




This proves the upper bound in Lemma 15.21 after sending <5 — > while keeping in 
mind that in this case, 

\D n F*\ < \D n F 2 \ < 00 and \D m F*\ < |D m Fi| < 00 

for n = 1, . . . ,4 and m = 1, 2. To get the upper bound in Lemma l5.4l we only need 
to note that in this case \D n Fj\o < CS 1 ^ 5 , n € N, j = 1, 2, and then minimize (|5.8|) 
w.r.t. S. 

The upper bounds follow in a similar way. We conclude the proof simply by 
giving the expression corresponding to l|5.8[l . 



G 



At\D 2 fr} + 5 

\D 2 F ltS \ [At\D^\ 2 + At 2 \D 3 F2,s\o\D 3 <p\t + At 3 \D 3 F 2 j\ 2 \D 







□ 



Proof of Lemma \5.fA Let 

w = <b-tF s {D 2 0), 

and observe that 

(5.9) w t + F(D 2 w) = -F s (D 2 (j>) + F(D 2 <P) - F(D 2 <P) + F{D 2 w) 

Since F is convex, it is easy to see that Fg(X) > F(X), and hence 



(5.10) 



\DF\q8 < -F S (D 2 



F(D 



< 0. 
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The second difference, —F{D 2 cf)) + F(D 2 w), can be written 

/ — {F(sD 2 w + (1 - s)D 2 (j))\ds 
Jo ds 

= J^didjiw-cP) [ (d Xzj F)(sD 2 w + (1 - S )D 2 cp)ds 

(5.11) =-ty2d l d J {F s (D 2 cp)} f (d Xt] F){sD 2 w + (1 - s)D 2 cj>)ds. 

Jo 

y 

We expand didj{Fs(D 2 (f>)} and get 



( 9x *' dx ™ P^ 2 ^ (didkdl(f>) (djdmdnt 

zlmn 



kl 

We call the first term M [<fi] y . 

Since dx kl dx mn Fg — dx mn dx kl F$, it follows that M is symmetric, 

= M[<f>]ji. 

Moreover, since F is convex, M is positive semidefinite: For every £ G 



klmn i j 

= ( d x kl 9x mn F s )(D 2 ^)Y kl Y mn > 0, 

klmn 

where Yij — didj(^2 k £kdk4>) and where the inequality follows by convexity of F. 

By the spectral theorem there exists e k £ M. N and € K for k = 1,...,N 
(depending on cf>) such that 

k 

Furthermore, since M is positive semidefinite, Aj > for i = 1, . . . , N. Therefore 
we have 

V M M« / (8 Xil F)(sD 2 w + (1 - s)D 2 ct ) )ds 

k J ° a 

where the inequality follows from the fact that F is nonincreasing. We conclude 
that 

F{D 2 w)-F{D 2 4>) > -t\DF\o\D 2 Fs\o\D 4 q>\o, 
and hence by (|5.9(l - (|5.11|l we get 

w t + F(D 2 w) > -\DF\ S - t\DF\ Q \D 2 F s \o\DU\o- 
The first part of the Lemma now follows from the comparison principle. 
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The second part of the Lemma follows from (|5.9|l - Q5.11|l and the comparison 
principle after noting that this time, due the its sign, the D 2 Fs term will be part 
of the error expression. □ 

5.2. Piecewise constant controls. Here we study approximations by piecewise 
constant controls. Such approximations have been studied e.g. in |25l I22| (see also 
the references therein). We consider the following simplified version of equation 

O- 

(5.12) u t + xaax{-L i u- f{x)} = in Q T , 

i 

where 

i> = tr[cr 4 {x)<j lT (x)D 2 <f>} + b l {x)D(j> + c 4 (x)</>, 

and a, b, c and / satisfy assumption (Al) when a is replaced by i. Note that the 
coefficients are independent of time. We approximate (|5.12() in the following way, 

(5.13) u n+1 (x) = mmS l (At)u n {x) in {0, 1, . . . , n T } x ™ N 



where Si(t)<f>(x) denotes the solution at (t,x) of the linear equation 
(5.14) ut-L'u- f(x) =0 

with initial data <fr at time t = 0. As usual, u n is expected to be an approximation 
of u(t n , x), t n := nAt, and we are looking for a bound on the approximation error. 

Under assumption (Al) the comparison principle holds for the linear equations 
(|5.14p . hence Si and min^ Si are monotone. Furthermore, we have the following 
consistency relation: 

Lemma 5.7. If (Al) holds, then for any smooth function <fi we have 
— [imnSi(At) - l]0(tn_i, x) + Atmax{-£*>(*n,z) - f(x)}\ 

At i i 

< CAi|D 2 t | o + CAt ( \D n ^\o + 1 J + CAt 1 ' 2 (^2 l^lo + 1 ) ■ 

We have the following error bound: 

Proposition 5.8. Assume (Al). Letuh denote the solution of l|5.1|l corresponding 
to 

Sh{t n -i,t n ) = min Si (At) 

i 

and Uh.o = Uo, and let u be the solution of l|5.12|l with initial value uq. Then 

-CAm < u - u h < m At{0,l,2,...,n T } xR N . 

Proof. We first observe that > u in Qx- This can be easily seen from the control 
interpretation of Uh (which we have not provided!) or from the comparison principle 
since Uh is a supersolution of l|5.12(l (solutions of l|5.14|l are supersolutions of (|5.12() 
and so is the min of such solutions). The other bound follows from Lemma 15 . 71 and 
Proposition D 

Remark 5.6. Assuming more regularity on the coefficients does not lead to any 
improvement of the bound. The principal contribution to the error comes from the 
|-D 4 (/>|o-term, and this term does not depend on the regularity of the coefficients 
(only on the L°° norm of a). 
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Remark 5.7. In |22| Krylov obtains a better rate, namely 1/6. His approach is 
different for ours, he works on the dynamic programming principle directly using 
control techniques. 

Proof of Lemma \5. 7| Let a\ — a 1 * p$ , and define similarly b g , c s , and /J , and let 
L\ be the operator L l corresponding to a l s ,b s ,c l s . Observe that 

| mmSi(t)<l> - + tmax{-i|0 - fi(x)}\ 

i i 

= | rmn{Si{t)4> - 0) - tmin{L|</> + fj(x)}\ 
< max \Si(t)tf> - + t(-L* s 4> - f s (x))\. 

Next, define 

^ = <f>~ t(-L s <f> - fl(x)) ± \t 2 \VL^ - LVJlo ± t\(L s - U)cp - {ft - /%, 

and observe that u> + is a supersolution of (|5.14|l while w~ is a subsolution. By the 
comparison principle and properties of mollifiers we get 

|#(t)0-0 + t(-Z^-/j(aO)| 
< ^|L 4 L^ - LYilo + tSC (j2 l^lo + x ) • 

Furthermore, by properties of mollifiers and the Lipschitz regularity of the coeffi- 
cients we see that 

\isl\4, + uftio < c ( E \° n ^ + S ^ E i^ T vio + <T X + 1 J • 

\n=0 n=0 / 

By combining the above estimates we get 
| min Si(t)(p - <p + tmax{-L i (f> - ft{x)}\ 

i 

< ct 2 (j2 1^1° + E i^^io + rl + 1 J + tsc ( E i^^io + 1 ) . 

\n=0 n=0 ) \n=Q ) 

and the result follows by similar arguments as was given in the proofs of Lemmas 
15.21 and 15.41 after optimizing w.r.t. 6. □ 

6. Remarks on the Holder continuous case 

In this section we give an extension of the main result Theorem 13. II to the case 
when solutions of do no longer belong to the space C 0,1 but rather belong to 
the bigger space C 3 for some (3 £ (0, 1). 

In the time-dependent case C@ regularity of the solution is observed typically 
when assumption (Al) is relaxed in the following way: 

(Al') For any a € A, a a = \a a a aT for some N x P matrix a a . Moreover, there 
is a constant K independent of a such that 

\u Q \p + \cx a \ 1 + \b a \ 1 + \c a \p + \f a \p<K. 

In other words Uo, c a , f a now belongs to C 3 . 

Lemma 6.1. If (Al') holds, then there exists a unique solution u E C°'^(Q T ) of 
(fTTTft and <|P|. 
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This standard result is proved e.g. in ^J- We claim that under (AT), we have 
the same regularity (the same [3) for all equations considered in this paper. Wc 
skip the proof of this claim. In the rest of this section, the solutions of the different 
equations belong to C°'"(Q T ) with the same fixed (3 G (0, 1]. 

Lower than C° :1 regularity of solutions implies lower convergence rates than 
obtained in Sections El - We will now state the Holder versions of some these 
results without proofs. The proofs are not much different from the proofs given 
above, and moreover, the Holder case was extensively studied in P^. We start by 
the convergence rate for the switching system approximation of Section [21 

Proposition 6.2. Assume (AV). If u and v are the solutions of (|2.2|) and (|2.1|) 

in C 0, P(Q T ), then for k small enough, 

< Vi - u < Ck^? in Q T , i G J, 
where C only depends on T and K from (AV). 

In order to state a C 3 version of Theorem 13.11 we need to modify assumption 
(S3). The requirement on <f> £ should be changed to 

\d^D^'4> e (x,t)\ < KeP-^o-W'l in Q T , for any f3 G N, f3' G N w . 

We will denote the modified assumption by (S3'). Now we state the C 3 version of 
our main result, Theorem 13. II 

Theorem 6.3. Assume (AV), (SI), (S2) and that l|1.3f) has a unique solution 
u% G Cb{Qh)- Let u denote the solution of i|l.l|) - (|1.2|) . and let h be sufficiently 
small. 

(a) (Upper bound) If (S3')(i) holds, then there exists a constant C depending 
only /i, K in (SI), (AV) such that 

u-u h <e^\(u -Uo^ h ) + \ + Cmm(e p + Ei{K,h,e)) in Gh, 

E>0 \ / 

where K = \u\i. 

(b) (Lower bound) // (S3')(ii) and (A2) holds, then there exists a constant C 
depending only (i, K in (SI), (AV) such that 

u- u h > -e"*|(uo - u , h y\ Q - Cmin +E 2 (K, h,e)\ in Q h , 

where K = |xe|x - 

Remark 6.1. For the FDMs described in Section 21 we get an upper rate of f and 
a lower rate of ^ 2 +p)-2p m ^ e ^ case. Compare with Theorem 14. II 

Appendix A. Well-posedness, regularity, and continuous dependence 

FOR SWITCHING SYSTEMS 

In this section we give well-posedness, regularity, and continuous dependence 
results for solutions of a very general switching system that has as special cases the 
scalar HJB equations <|l.l[l . and the switching systems (|2.1[l . 12. 3|) . I|3.3|l . 

We consider the following system: 

(A.l) F i (a;,ti J fl| t u i ,Dtt i ,D 9 u i )=0 in Q T , i G X := {1, . . . ,M}, 
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with 

Fi(t,x,r,p t ,p x ,X) = max I p t + sup inf £" ,/3 (a;, n,p x , X); - M t r \, 

£?'"(t, *, q, X) = -tr[o^(t, - 6^(t, z)g - c^(*, z) S - jf ^ 

where Ai is defined below l|2.1|) . „4, £> are compact metric spaces, r is a vector 
r = (n, . . . ,rjw), and fc > is a constant (the switching cost). See [TH 171 051 IT71 l*H)) 
for more information about such systems. 
We make the following assumption: 

(A) For any a, /3, i, a"' 13 = \o\'^ Vf ,/3 for some N x P matrix erf' 13 . Furthermore, 
there is a constant C independent of i, a, (3, t, such that 

W? fi (t, OK + \bt' (t, -)|i + WT (t, Oli + l/f "(t, OK < c. 

We start by comparison, existence, uniqueness, and L°° bounds on the solu- 
tion and its gradient. Before stating the results, we define USC(Qt', K m ) and 
LSC(Qt', M m ) to be the spaces of upper and lower semi-continuous functions from 
Qt into R M respectively. 

Theorem A.l. Assume (A) holds. 

(i) If u S USC(Qt', M. m ) is a subsolution of (|A.1|I bounded above and v € 
LSC(Qt',^ m ) supersolution of l|A.l|) bounded below, then u < v in Qt- 

(ii) There exists a unique bounded continuous solution u of (|A.1|I . 

(Hi) The solution u of (|A.1I) belongs to C 0,1 (Qt), and satisfies for all t,s € [0, T] 

e~ At max|u l (i, -)| < max \u ,i\o + 1 sup |/f ,/3 |o, 

* 1 i,a,/3 

where A := sup ia /3 |cf^ + | , 

e At)t maxMi,-)]i < maxKJi+f sup f \u*\ [<$ ' p (s, -)]i + [/f^s, Oh}. 

w/iere A := sup laJ3s {\c"' 0+ (s, -)|o + Wf" (s, -)]i + [^(^ OKI; a™ d 
max |xtj(£, x) — Uj(s, x)| < C|£ — s| 1//2 , 

i 

where C < 8MC + VTC(2M + 1) and M := sup i>t -)|i- 

Before giving the proof we state a key technical lemma. 

Lemma A. 2. Let u £ USC(Qt',^. m ) be a bounded above subsolution of l|A.ll) 
and u £ LSC(Qt',^- M ) be a bounded below supersolution of an other equation 
(lA.lfl where the functions Cf'^ are replaced by functions Cf'^ 3 satisfying the same 
assumptions. Let <j> : [0, T] x M. 2N — > R be a smooth function bounded from below. 
We denote by 

rpi(t, x, y) = m(t, x) - Ui(t, y) - (j>(t, x, y) , 

and M = sup, t x y ?pi(t,x,y). If there exists a maximum point for M , i.e. a 
point {i 1 , to, xo, yo) such that ipi'(to,%o,yo) — M, then there exists io £ 1 such 
that (io,to,Xo,yo) is also a maximum point for M, and, in addition Ui (to,yo) < 
M lo u{t a ,y ). 
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Loosely speaking this lemma means that whenever we do doubling of variables for 
systems of the type (| A. 1|> . we can ignore the Ui — MiU parts of the equations. So we 
are more or less back in the scalar case with equations dtUi +sup a inf p £^ [ui ] < 
and d t Ui + sup Q infg £,"^[ili ] > 0. We skip the proof since it is similar to the proof 
given in |2] for the stationary case. 

Proof of Theorem \A.l\ Comparison, uniqueness, and existence is proved in |17| for 
the stationary Dirichlet problem for 1)1.1(1 on a bounded domain under similar as- 
sumptions on the data. To extend the comparison result to a time dependent 
problem in an unbounded domain, we only need to modify the test function used 
in |17| in the standard way. (See also the arguments given below). Comparison 
implies uniqueness, and existence follows from Perron's method. This last argu- 
ment is similar to the argument given in |17| . but easier since we have no boundary 
conditions other than the initial condition. 
Let 

w(t) := e xt \ max \u 04 \ + t sup |/f ,/3 |o [, 

1 1 i,a,P J 

then the bound on |u|o follows from the comparison principle after checking that w 
(—iv) is a supersolution (subsolution) of (|A.1(I . 
To get the bound on the gradient of u, consider 

m := sup {ui(t,x) — Ui(t,y) - w(t)\x — y\} , 

i,t,x,y£R N 

where 

w(t) := ^{maxKili+i sup {\ Ui \o[c^(s, -)]i + [Jf^s, -)]i}}. 

We are done if we can prove that m < 0. Assume this is not the case, m > 0, and 
for simplicity that this maximum is attained in i, x, y. Then there exists a k > 
such that 

Ui(i,x) - Ui(i,y) - w(t)\x - y\ - te Xot k > 0, i el. 

Let tpi(t, x, y) := Ui(t, x) — Ui(t, y) — w(t)\x — y\ — te Xot k, then ip also has maximum 
M > at some point (i,t,x,y). Since M > 0, x ^ y and t > 0. Therefore 
w(t)\x — y \ + te Xot k is a smooth function at (t, x, y) and a standard argument using 
the viscosity sub- and supersolution inequalities for (|A.1|I at (t,x,y) and Lemma 
IA.2I leads to k < 0. See the proof of Theorem I A . 31 for a similar argument. This is 
a contradiction and hence m < 0. 

In the general case when the maximum m need not be attained at some finite 
point, we must modify the test function in the standard way. We skip the details. 

To get the time regularity result, assume that s < t and let u e be the solution 
of i|A.l|) in t e (s, T] starting from u(s, ■) * p e (x) =: Uq(x). By the comparison 
principle 

\u-u £ \< sup [u(r,-)]ie in [s,T]xM w , 

r6[s,T] 

and easy computations show that 

wf(t,x) = e xt {u e (x) ± (t-s)C e \ 

are subsolution (w~) and supersolution (w + ) of (|A.1|I if 

C e = C 2 \D 2 ul\ + C(\Du e \ + \u B \o + 1) 
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and C is given by (A) . Another application of the comparison principle then yields 

w~<u e <w+ in [s.rjxR". 
The result now follows from 
\u(t, x) — u(s, x)\ 

< \u(t, x) — u £ (t, x)\ + \u £ (t, x) — ul(x)\ + \ul(x) — u(s, x)\ 

< ([u(t, .)] 1 + [ u (s,.)] 1 )e+\t-s\C e , 

and a minimization in e after noting that C £ < C(s^ 1 + 1). □ 
We proceed to obtain continuous dependence on the coefficients. 

Theorem A. 3. Let u and u be solutions of (|A.f |l with coefficients a,b,c,f and 
a,b,c,f respectively. If both sets of coefficients satisfy (Al), and \u\q + \u\o + 
[u(t, + [u(t, < M < oo for t £ [0,T], then 

e" At max •) - Ui(t, -)\ < max \ui(0, ■) - u,(0, -)|o 

i i 

+ t x l 2 K sup \a - a\ + t sup \2M\b - b\ + M\c - c\ + \f - f\ \, 

where A := sup i a g \c~\q and 

K 2 < 8 M 2 + 8MT sup \2M[a}\ A [a]\ 

+ 2Af[ft]i A + M[c]i V [c]i + A [/h}. 
Proof. We only indicate the proof in the case A = 0. Define 

^(t, x, y) := Ui (t, x) - Ui (t, y) - l\ x - y\ 2 - e(\x\ 2 + \y\ 2 ), 
m:= sup %/} % (t,x,y) - sup(ip*(0,x,y)) + , 

i,t,x,y ii^iV 

fh := sup | ^(t, x, y) 



i,t,x,y 



T 



where a £ (0, 1). We assume m > since otherwise we are done. We will now 
derive an upper bound on m. To do this we consider fh. By the assumptions 
this supremum is attained at some point (io, to, xq, yo). Since m > it follows 
that m > and to > 0, and by Lemma I A. 21 the index io may be chosen so 
that Ui (to,yo) < ■Mi u(tQ,j/o). With this in mind, the maximum principle for 
semi continuous functions [HI Ej and the definition of viscosity solutions imply the 
following inequality: 

Pt-Pt + snpMC"f(t ,x ,u l0 ,p x ,X) - supinf Iff (t , y ,u l0 ,p y ,Y) < 0, 

a P a P 

2 -f- 2 _ __ 

where (p t ,p x ,X) e V ' u io (x ) and (p t ,p y ,Y) e V' u io (y ) (see [HI E] for the 

notation). Furthermore p t -p t = = ^(xo-y ) + 2ex , p y = |(x -y ) -2ey , 
and 

- »)<§(_', ?)+««>• 
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for some k > 0. In the end we will fix a, 5, and s and send k — > 0, so we simply 
ignore the C(«:)-term in the following. The first inequality implies 

^— < sup { - tr[a(t , yo)Y] + tr[a(*o, z )X] + &(*o, yo)p K - &(*o, £o)Py 

+ c(i ,yo)w(*o,2/o) -c(i ,a:o)«(*o,a:o) + /(*o,2/o) + /(*o,#o)j, 
Note that Lipschitz regularity of the solutions and a standard argument yields 

\x Q -y \<5M. 

So using Ishii's trick on the 2nd order terms ^3 pp. 33,34], and a few other 
manipulations, we get 

^7? < sup \^\a(t ,x ) - a(t Q ,y )\ 2 + 2M\b(t 0l x ) - b(t ,y )\ 

1 i,a,p L 

+ Ce{l + \x Q \ 2 + \ y() \ 2 ) 

+ M\c(t ,x ) - c(t Q ,y Q )\ + \f(t Q ,x ) - f(t ,y )\\. 

Some more work leads to an estimate for m depending on T, c, <5, and e, and using 
the definition of m and estimates on sup^ x y ipi(0, x, y), we obtain a similar upper 
bound for u — u. We finish the proof of the upper bound on u — u by sending 
a — > 1 , minimizing this expression w.r.t. 8, sending e — > 0, and noting that the 
result still holds if we replace T by any t G [0, T]. The lower bound follows in a 
similar fashion. □ 

Remark A.l. For more details on such manipulations, we refer to |19j . 



References 

[1] G. Barles and E. R. Jakobsen. On the convergence rate of approximation schemes for 
Hamilton-Jacobi-Bellman equations. M2AN Math. Model. Numer. Anal. 36(l):33-54, 2002. 

[2] G. Barles and E. R. Jakobsen. Error bounds for monotone approximation schemes for 
Hamilton-Jacobi-Bellman equations. To appear in SIAM J. Numer. Anal. 

[3] G. Barles and P. E. Souganidis. Convergence of approximation schemes for fully nonlinear 
second order equations. Asymptotic Anal. 4(3):271-283, 1991. 

[4] F. Bonnans, E. Ottenwaelter, and H. Zidani. A fast algorithm for the two dimensional HJB 
equation of stochastic control. M2AN Math. Model. Numer. Anal. 38(4):723-735, 2004. 

[5] F. Bonnans and H. Zidani. Consistency of generalized finite difference schemes for the sto- 
chastic HJB equation. SIAM J. Numer. Anal. 41(3):1008-1021, 2003. 

[6] F. Camilli and M. Falcone. An approximation scheme for the optimal control of diffusion 
processes. RAIRO Model. Math. Anal. Numer. 29(1): 97-122, 1995. 

[7] I. Capuzzo-Dolcetta and L. C. Evans. Optimal switching for ordinary differential equations. 
SIAM J. Control Optim. 22(1):143-161, 1984. 

[8] M. G. Crandall and H. Ishii. The maximum principle for semicontinuous functions. Differen- 
tial Integral Equations, 3(6):1001-1014, 1990. 

[9] M. G. Crandall, H. Ishii, and P.-L. Lions. User's guide to viscosity solutions of second order 
partial differential equations. Bull. Amer. Math. Soc. (N.S.), 27(l):l-67, 1992. 
[10] M. G. Crandall and P.-L. Lions. Two approximations of solutions of Hamilton- Jacobi equa- 
tions. Math. Comp. 43(167):1-19, 1984. 
[11] H. Dong and N. V. Krylov. On the rate of convergence of finte-difference approximations for 

Bellman equations with constant coefficients. To appear in St. Petersburg Math. J. 
[12] H. Dong and N. V. Krylov. On the Rate of Convergence of Finite-difference Approximations 

for Parabolic Equations with C 1 and C 2 Coeffcients. Preprint. 
[13] H. J. Kushner and P. Dupuis. Numerical methods for for stochastic control problems in 
continuous time. Springer- Verlag, New York, 2001. 



32 



BARLES AND JAKOBSEN 



[14] L. C. Evans and A. Friedman. Optimal stochastic switching and the Dirichlet problem for 

the Bellman equation. Trans. Amer. Math. Soc. 253:365-389, 1979. 
[15] H. Ishii. On uniqueness and existence of viscosity solutions of fully nonlinear second-order 

elliptic PDEs. Comm. Pure Appl. Math., 42(l):15-45, 1989. 
[16] H. Ishii and S. Koike. Viscosity solutions for monotone systems of second-order elliptic PDEs. 

Comm. Partial Differential Equations 16(6-7):1095-1128, 1991. 
[17] H. Ishii and S. Koike. Viscosity solutions of a system of nonlinear second-order elliptic PDEs 

arising in switching games. Funkcial. Ekvac., 34:143-155, 1991. 
[18] E. R. Jakobsen. On the rate of convergence of approximation schemes for Bellman equations 

associated with optimal stopping time problems. Math. Models Methods Appl. Sci. (M3AS) 

13(5):613-644, 2003. 

[19] E. R. Jakobsen and K. H. Karlsen. Continuous dependence estimates for viscosity solutions of 

fully nonlinear degenerate parabolic equations. J. Differential Equations 183:497-525, 2002. 
[20] N. V. Krylov. On the rate of convergence of finite-difference approximations for Bellman's 

equations. St. Petersburg Math. J., 9(3):639-650, 1997. 
[21] N. V. Krylov. On the rate of convergence of finite-difference approximations for Bellman's 

equations with variable coefficients. Probab. Theory Ralat. Fields, 117:1-16, 2000. 
[22] N. V. Krylov. Approximating value functions for controlled degenerate diffusion processes by 

using piece- wise constant policies. Electron. J. Probab. 4(2), 1999. 
[23] N. V. Krylov. On the rate of convergence of finite-difference approximations for Bellman 

equations with Lipschitz coefficients. To appear. 
[24] P.-L. Lions. Personal communication. 

[25] P.-L. Lions and B. Mercier. Approximation numerique des equations de Hamilton-Jacobi- 

Bcllman. RAIRO Anal. Numer. 14(4):369-393, 1980. 
[26] C.-W. Shu Total-variation-diminishing time discretizations. SIAM J. Sci. Statist. Comput. 

9(6):1073-1084, 1988. 

[27] P. E. Souganidis. Approximation schemes for viscosity solutions of Hamilton- Jacobi equations. 

J. Differential Equations 59(l):l-43, 1985. 
[28] N. Yamada. Viscosity solutions for a system of elliptic inequalities with bilateral obstacles. 

Fuckcial. Ekvac. 30(2-3):417-425, 1987. 

(Guy Barles) 

Laboratoire de Mathematiques et Physique Theorique 
University of Tours 
parc de grandmont 
37200 TOURS, France 

E-mail address: barles@lmpt.univ-tours.fr 

URL: http://www.phys .univ-tours . f r/~barles 

(Espcn R. Jakobsen) 
Department of Mathematical Sciences 
Norwegian University of Science and Technology 
N-7491 Trondheim, Norway 

E-mail address: erjamath.ntnu.no 

URL: http : //www . math . ntnu . no/~er j 



